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METHODOLOGY  FOR  ACCEPTANCE  CRITERIA  FOR 
TARGET  DISPERSION  CHARACTERISTICS  OF  THE 
ARMOR  PIERCING  DISCARDING  SABOT  (APDS)  ROUNDS 

1.  INTRODUCTION 

1.1  General 


The  estimation  of  target  dispersion  characteristics  of  Armor 
Piercing  Discarding  Sabot  (APDS)  ammunition  in  acceptance  testing  is 
accompanied  by  a number  of  difficulties.  Test  costs  are  high;  therefore 
sample  sizes  are  limited.  Since  dispersion  patterns  are  subjected  to 
relatively  large  variations,  small  sample  sizes  produce  undesirable 
levels  of  inaccuracy  in  estimating  dispersion  characteristics.  Control 
of  test  conditions  throughout  the  test  is  limited  to  control  of  only  a 
few  factors  such  as  tube  aim  point,  cant,  stability  of  the  firing  plat- 
form and  tube  condition,  at  the  start  of  the  test.  Even  with  maximum 
possible  control  of  such  factors,  they  still  exert  a degree  of  error  in 
round-to-round  target  impact  points.  In  addition,  there  are  several 
uncontrollable  factors,  such  as  wind  and  weather  conditions,  tube  wear 
from  round  to  round,  droop,  jump  and  other  unknowns,  which  make  it 
impossible  to  obtain  uniform  conditions  throughout  the  test.  These 
problems  have  accompanied  every  acceptance  test  conducted  on  APDS 
ammunition  and  have  been  exacerbated  by  two  factors: 

o The  lack  of  established  test  procedures  designed  to 
minimize  the  effects  of  uncontrollable  test  condition 
variations  and 

o The  lack  of  established  acceptance  criteria  and 
estimation  procedures  designed  to  minimize  consumer 
and  producer  risks. 

The  result  has  been  that  a large  number  of  lots  of  APDS 
ammunition  with  very  poor  target  dispersion  characteristics  have  been 
accepted  for  use. 

1 . 2 Purpose 

This  report  develops  methodology  which  can  be  used  to  derive 
acceptance  plans  for  target  dispersion  characteristics  of  APDS  rounds. 

In  developing  the  methodology,  the  effect  of  test  condition  variations 
upon  target  dispersion  patterns  and  the  lack  of  established  acceptance 
criteria  and  estimation  procedures  are  addressed.  Examples  of  inadequate 
firing  procedures  in  accuracy  tests  of  APDS  rounds  are  presented,  and 
corrective  measures  are  proposed.  Examples  of  acceptance  criteria  and 
estimation  procedures  which  minimize  consumer's  and  producer's  risks  are 
developed.  Several  acceptance  plans,  derived  from  the  proposed  method- 
ology are  presented. 


Background 


The  objective  of  an  accuracy  acceptance  test  of  APDS  rounds  is 
to  assess  the  dispersion  pattern  which  characterizes  a lot  of  ammunition 
and  accept  or  reject  the  lot.  The  acceptance  test  requires  firing  a 
group  of  rounds  at  a vertical  target  some  distance  from  the  gun.  The 
coordinates  of  the  impact  points  of  each  round  in  the  group  are  obtained, 
and  estimates  of  the  dispersion  about  the  center  of  impact  are  determined. 


When  firing  a group  of  rounds  to  assess  dispersion  character- 
istics, it  is  desirable  to  have  identical  test  conditions  for  each  round. 
In  this  manner,  the  differences  in  impact  points  of  each  round  are  the 
result  only  of  inherent  differences  between  the  rounds.  Inherent 
differences  between  rounas  vn  a lot  of  APDS  ammunition  are  due  to  chance 
variation  within  a stable  pattern  caused  by  manufacturing  procedures  and 
physical  characteristics  of  the  round  and  propelling  charge.  These 
inherent  differences  lead  to  different  flight  characteristics,  and  cause 
rounds  to  impact  at  different  points  on  the  target.  If  identical  test 
conditions  are  obtained,  the  dispersion  characteristics  of  the  group  of 
rounds  fired  reflect  the  degree  of  round-to-round  uniformity  in  the 
manufacturing  process  and  provide  an  estimate  of  quality  control. 


Unfortunately,  test  conditions  from  round  to  round  are  not 
identical.  Gun  elevation  and  deflection  vary  regardless  of  efforts  to 
maintain  a constant  aim  point.  Weather  conditions  and  other  factors 
which  effect  accuracy  also  vary  from  round  to  round.  Consequently, 
the  dispersion  pattern  of  a group  of  rounds  on  a target  is  not 
representative  of  the  inherent  round-to-round  differences.  The 
dispersion  pattern  consequently  represents  the  combination  of  the 
inherent  differences  in  rounds  and  the  variability  in  test  conditions 
from  round  to  round. 


2.2  Firing  Procedures 


The  method  of  firing  employed  in  an  acceptance  test  of  a lot  of 
APDS  ammunition  must  be  conducted  in  a way  that  minimizes  the  effect  of 
round-to-round  variability  in  test  conditions.  In  past  acceptance 
tests,  gun  elevation  and  deflection  settings  have  been  controlled 
to  a great  extent,  and  severe  weather  conditions  have  been  avoided. 
However,  the  method  of  firing  in  acceptance  tests  has  not  been  one  which 
minimized  round-to-round  variability  in  test  conditions.  The  length 
of  time  required  to  fire  a group  of  rounds  has  been  as  great  as  four 
hours.  Test  conditions  such  as  tube  droop,  cant,  ambient  environmental 
conditions  and  other  unknowns  vary  more  over  a long  time  interval  than 
they  do  in  a short  one.  Hence,  as  shown  by  an  analysis  of  past  acceptance 
tests  of  105mm,  APDS  ammunition,  a group  of  rounds  fired  over  a long 
time  period  will  tend  to  exhibit  higher  probable  errors  than  would  be 
observed  over  a short  time  period. 
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Figure  1 shows  the  accuracy  results  of  an  acceptance  test  of 
105mm,  APDS  rounds  conducted  at  Jefferson  Proving  Ground.  Horizontal 
and  vertical  probable  errors  are  presented  as  a function  of  time  between 
rounds.  The  wind  ranged  from  2-10  knots  and  varied  in  direction  from 
140°  to  180°  during  the  course  of  the  test.  The  probable  errors  for  the 
entire  25  round  group  were  calculated  at  0.47  mils  in  the  horizontal 
direction  and  at  0.29  mils  in  the  vertical  direction.  Probable  errors 
as  a function  of  time  between  rounds  were  obtained  by  analyzing  all 
combinations  of  two  round  groups  in  the  test.  The  probable  errors  for 
each  two  round  group  were  calculated  and  correlated  with  time  between 
rounds  fired.  Although  the  trend  in  Figure  1 is  linear,  other  shapes 
may  be  expected  from  the  testing  of  other  lots. 

Figure  1 clearly  illustrates  that  during  an  accuracy  test  the 
dispersion  of  impacts  is  greatly  affected  by  the  test  conditions,  which, 
in  turn,  vary  with  time. 

The  firing  procedures  employed  in  acceptance  tests  have  not 
been  designed  to  minimize  the  time  over  which  a group  of  rounds  is  to  be 
fired.  In  the  past,  as  many  as  three  different  lots  were  often  tested 
simultaneously,  with  rounds  from  each  lot  fired  alternately,  with 
reference  rounds.  The  effect  quadrupled  the  amount  of  time  required 
to  fire  each  test  group  of  each  lot.  Consequently,  the  effect  on 
dispersion  due  to  variations  in  round-to-round  test  conditions,  has 
been  greater  than  that  which  could  have  been  obtained  if  the  time  for 
firing  each  group  were  reduced. 

In  conducting  an  acceptance  test,  the  individual  groups  of 
rounds  from  a test  lot  should  be  fired  sequentially  with  no  alternate 
firing  of  reference  rounds  or  rounds  from  other  test  lots  between 
rounds  within  a group.  The  time  for  firing  each  group  of  rounds 
can  thus  be  minimized  to  the  greatest  extent  possible.  If  reference 
rounds  are  to  be  fired,  each  group  of  reference  rounds  should  be  fired 
either  before  or  after  each  group  of  test  rounds.  For  example,  if  two 
ten  round  samples  from  a single  lot  are  to  be  tested  with  fifteen 
reference  rounds,  the  order  of  firing  could  be: 

Five  Reference  Rounds 

Ten  Sample  Rounds 

Five  Reference  Rounds 

Ten  Sample  Rounds 

Five  Reference  Rounds 

Estimates  of  probable  errors  for  each  group  of  rounds  would 
then  be  calculated  and  pooled  accordingly. 
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HORIZONTAL  PROBABLE  ERRORS 


rrobable  errors  Ubserved  Uunng  an  Acceptance  lest  ot  a bin 
105MM,  M392,  APDS  as  a Function  of  Time  Between  Rounds 


3.  CALCULATION  PROCEDURES 


When  a group  of  rounds  is  fired  over  a short  time  interval,  the 
effect  of  nonuniform  test  conditions  from  round  to  round  will  still 
persist.  Movement  of  the  mean  center  of  impact  from  round  to  round  may 
occur,  and,  if  so,  the  effect  of  this  trend  on  calculated  probable  errors 
may  be  eliminated  by  the  method  of  successive  differences  (Reference  1). 
For  example,  suppose  the  following  impact  coordinates,  measured  in  inches, 
are  obtained  for  a group  of  ten  rounds  fired  at  a vertical  target  1000 


meters  from  the  gun: 

Round 

Horizontal 

Vertical 

Number 

Coordinate  (x) 

Coordinate 

1 

65 

110 

2 

70 

120 

3 

60 

115 

4 

75 

100 

5 

70 

105 

6 

85 

95 

7 

80 

90 

8 

95 

95 

9 

90 

85 

10 

100 

75 

Calculating  probable  errors  in  the  usual  manner  for  the  entire 
ten-round  group  (References  2 and  3)  yields. 

Horizontal  probable  error  = 0.23  mils 
Vertical  probable  error  = 0.24  mils 
Circular  probable  error  = 0.41  mils. 

Calculating  probable  errors  using  the  method  of  successive 
differences  yields, 

Horizontal  probable  error  = 0.13  mils 
Vertical  probable  error  = 0.11  mils 
Circular  probable  error  = 0.21  mils. 

The  method  of  successive  differences  results  in  approximately 
a 50  percent  reduction  in  probable  error  estimates  in  this  particular 
example.  The  probable  errors  calculated  by  the  standard  method  include 
the  effects  of  test  condition  variability  over  the  entire  ten-round 
group,  while  the  probable  errors  calculated  by  the  method  of  successive 
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differences  include  only  the  test  condition  variability  between  successive 
rounds.  Whenever  the  variation  in  test  conditions  is  nonrandom,  the 
result  is  a nonrandom  dispersion  pattern  of  shots  about  the  center  of 
impact.  A trend  of  this  type  indicates  that  test  condition  . lability 
over  the  entire  group  is  greater  than  the  variability  between  successive 
rounds.  When  this  type  of  trend  occurs,  the  use  of  the  method  of  success- 
ive differences  provides  dispersion  estimates  which  include  only  the  effects 
of  round-to-round  test  condition  variability.  In  this  manner,  the  effect 
of  variability  over  the  entire  group  is  eliminated. 


In  determining  the  dispersion  characteristics  of  a lot  from  a 
group  of  rounds,  it  is  therefore  desirable  to  limit  the  effect  of  test 
condition  variability  on  the  estimates  of  dispersion  to  that  variability 
which  occurs  only  between  rounds. 


It  can  be  shown  that  the  method  of  successive  differences 
provides  an  unbiased  estimate  of  the  square  of  the  probaole  error  (PE). 


From  statistical  theory,  an  unbiased  estimate  of  the  variance  (of)  in 


the  x direction  of  a two-round  sample  is  obtained  by 


- 2 1 2 

0X  = — (x1  - x2)  , where 


x-j  and  x2  are  the  coordinates  of  impact  on  the  x axis.  If  three  rounds 
are  fired  and  have  coordinates  of  impact  x-j , x2  and  x^  on  the  x axis, 


2 _ 1 


'lx 


2T  (xl  ' x2)2  and  S2x 


( x2  - x^ ) 


provide  two  unbiased  estimates  of  the  variance,  o 


. The  sample  variance 

x 2 o 

calculated  by  the  method  of  successive  differences  is  S = 1/2  S-,  + 

o o A I /\ 


2 2 
1/2  $2X,  and  it  is  an  unbiased  estimate  of  ox>  Since 


E<S(>  ■ E<’'2  Sl2x  * '/2  S2x> 


= E(l/2  S^)  + E(l/2  S2x) 


= 1/2  E(S]x)  + 1/2  E(S2x) 


2,.  . 2„ 

V2  * V2 


2 

= rt 


= o 


X' 


1 


c 

■ 

h 
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Similarly,  for  a sample  of  size  n 

= 1/2  (x.  - xi+1)2,  i - 1,  2 n-1 . 


n-1  » 

i y s 2 

ix’  the  sample  variance  calculated  by  the  method  of 


Then  S: 


successive  differences,  provides  an  unbiased  estimate  of  <r,  because 

E(sx}  = e(jtt  Ji  Six) 

n-1  , 

. -4  J E(six> 

rvT  i-1  lx 

n-1  0 

1 l °2 


n-1  i=l 
2 


Since  (PE  )2  = Ko2 


where  PE  = probable  error  in  the  x direction  and  K is  the  appropriate 
constant; 

E(PE2)  = E(KS2)  = Ko2  = PE2, 


where  PE2  = KS2  and  E(S2)  = o2. 

Hence,  the  method  of  successive  differences  gives  an  unbiased  estimate 
of  the  square  of  the  probable  error  between  rounds  in  the  x direction. 

A similar  proof  shows  that  the  method  of  successive  differences 
also  provides  an  unbiased  estimate  of  the  probable  error  squared  between 
rounds  in  the  v direction  and  also  in  the  radial  direction  (circular 
probable  error). 

Consequently,  the  use  of  the  method  of  successive  differences 
provides  unbiased  estimates  of  the  probable  error  squared  and  eliminates 
the  effect  of  nonrandom  test  condition  variation  upon  the  dispersion 
results  of  an  entire  group  of  rounds. 

Whenever  the  variation  in  test  conditions  is  nonrandom  and, 
thus,  results  in  a dispersion  pattern  which  is  not  random  about  the 
center  of  impact,  the  method  of  successive  differences  should  be  employed. 
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4.  ACCEPTANCE  CRITERIA 


4.1  Applicable  Parameters 

In  the  development  of  acceptance  criteria  for  dispersion  character- 
istics of  APDS  rounds,  parameters  appropriate  to  an  accept/reject  decision 
must  be  selected.  Horizontal  and  vertical  probable  errors  could  be  the 
basis  for  a decision  with  independent  criteria  for  each.  This  has  the 
disadvantage,  however,  of  not  utilizing  all  available  information.  For 
example,  the  observed  horizontal  and  vertical  probable  errors  in  a test 
could  be  0.10  mils  and  0.35  mils,  respectively.  The  pooled  average  of 
these  is  0.26  mils.  If  the  reject  criterion  is  to  reject  lots  when  either 
horizontal  or  vertical  probable  error  is  greater  than  0.30  mils,  this  lot 
would  be  rejected.  The  problem  with  this  type  of  accept/reject  criteria 
is  that  it  ignores  good  dispersion  characteristics  in  one  direction  when 
dispersion  in  the  other  direction  is  poor. 

Results  of  acceptance  tests  and  life  cycle  evaluations  of  105mm, 
M392,  APDS  rounds  have  shown  that  target  dispersion  patterns  are  approx- 
imately circular.  In  Reference  4,  for  example,  horizontal  and  vertical 
probable  errors  were  0.19  mils  and  0.21  mils,  respectively  for  803 
rounds  fired  from  a mid-life  tube.  Hence,  the  use  of  circular  probable 
error,  which  effectively  combines  all  dispersion  information  in  both  the 
horizontal  and  vertical  directions,  is  appropriate.  Use  of  this  parameter 
simplifies  the  accept/reject  criteria.  Another  advantage  of  using  the 
circular  probable  error  in  estimating  target  dispersion  rather  than  the 
present  technique  of  computing  independent  horizontal  and  vertical 
probable  errors,  is  that  the  sample  size  requirement  is  reduced 
significantly  for  the  specified  risk. 

4.2  Distribution  Of  Circular  Probable  Errors 

A lot  has  an  inherent  circular  probable  error,  CPE j , which 

describes  its  expected  performance  when  random  samples  from  the  lot  are 
fired  under  identical  test  conditions.  If  CPEg  is  the  circular  probable 

error  observed  for  a random  sample  fired  under  identical  test  conditions, 
then 

E(CPEq)  = CPE  j 

Since  circular  probable  error  is  a multiple  of  the  radial 
standard  deviation  it  follows  that. 
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where  is  the  observed  radial  standard  deviation,  and  °p  is  the 

expected  radial  standard  deviation  for  a random  sample  fired  under 
identical  conditions. 

2(n-l)CPE* 

The  distribution  of  5 — —will  therefore  be  Chi-square, 

CPE  j 

with  2 ( n-1 ) degrees  of  freedom  for  a random  sample  of  size  n fired  under 
identical  test  conditions. 

Identical  conditions  from  round  to  round  are  not  attainable 

CPE0 

during  testing,  however.  Therefore,  — 5- will  not  have  a Chi-square 

CPE  j 

distribution  during  tests.  In  fact,  CPE ^ cannot  be  adequately  estimated 

from  test  results,  since  the  effects  of  round-to-round  variability  in 
test  conditions  will  always  be  included  in  circular  probable  error 
estimates. 

To  develop  acceptance  criteria  for  APDS  rounds,  it  is  necessary 
to  know  the  form  of  the  distribution  of  CPEq.  It  is  also  necessary  to 

estimate  a circular  probable  error,  characterizing  a lot,  which  can  be 
determined  from  test  data. 

During  acceptance  testing,  the  effect  of  variation  in  test 
conditions  from  round  to  round  on  circular  probable  error  estimates  will 
vary  from  one  occasion  to  another.  On  some  days,  test  condition 
variability  has  little  effect  on  dispersion  patterns,  while  on  other  days, 
the  effect  of  variable  test  conditions  is  comparatively  large.  Obviously, 
measurements  which  characterize  a lot  or  its  expected  dispersion  should 
not  be  based  on  days  when  test  condition  variability  is  unusually  small 
or  large.  The  measurement  which  adequately  characterizes  the  performance 
of  a lot  should  be  based  on  the  outcome  expected  on  a randomly  selected 
day,  given  that  the  day  satisfies  the  meteorological  requirement  for 
conducting  an  acceptance  test. 

To  define  characteristic  circular  probable  error,  i.e.,  the 
probable  error  which  is  expected  from  a lot  on  a random  day,  we  assume 
that  a lot  of  infinite  size  is  available.  Let  N random  samples  be 
selected  from  the  lot  and  let  each  sample  be  tested  on  a random  day. 

Let  CPE-  denote  the  characteristic  circular  probable  error  of  the  lot. 
Then,  0 
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defines  the  characteristic  circular  probable  error  of  the  lot.  In  the 

p 

above  equation,  (CPEg).  is  the  square  of  the  circular  probable  error 

[N  ~i 

1 l (CPEg) . 1/2  equals  the 

expected  value  of  the  observed  circular  probable  error  on  a randomly 
selected  day,  it  is  clear  that  CPEr  adequately  defines  the  performance 
of  the  lot.  L 


On  some  days,  E(CPEg)  f CPE^ , since  variability  in  test  conditions 

such  as  wind  and  weather,  tube  wear  from  round  to  round,  droop,  jump, 
etc.,  may  be  unusually  large  or  small.  Suppose  conditions  on  a given 
day  are  such  that  E(CPEg)  = CPE^  for  the  random  samples  fired  on  that 

day.  Call  this  an  average  day. 


Now,  looking  only  at  tests  conducted  on  average  days  (days  for 
which  E(CPEq)  = CPE^s),  there  is  a characteristic  radial  standard 

deviation,  a which  describes  the  dispersion  characteristics  of  the  lot. 


Since  circular  probable  error  is  a multiple  of  radial  standard  deviation, 
then, 


cpe; 


cpe; 


°c2 


where  CPEg  is  the  circular  probable  error  observed  for  a random  sample 
tested  on  an  average  day,  and  S2  is  the  estimate  of  the  variance.  The 

2 

distribution  of  2^n  ^ ^^0  will  therefore  be  Chi-square  with  2 ( n- 1 ) 
CPE2 

degrees  of  freedom  for  a random  sample  of  size  n tested  on  an  average 
day. 


days,  and 


Acceptance  tests,  however,  are  not  usually  conducted  an  average 


CPEj 

CPF? 


has  in  actuality  greater  variability  than  that  predicted  by  the 
Chi-square  distribution.  To  assess  how  this  ratio  varies  during  acceptance 
tests,  the  dispersion  results  of  176  groups  of  105mm,  APDS,  M392  reference 
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rounds  were  analyzed.  Eight  of  these  groups  had  target  misses  and 
were  excluded  from  further  analysis.  The  remaining  groups  were  tested 
on  168  different  days  over  a twelve  year  period.  Each  group  consisted 
of  a ten  round  sample  from  one  of  two  reference  lots,  and  was  fired  at 
a target  2000  meters  from  the  gun.  There  was  no  significant  difference 
m the  distribution  of  circular  probable  errors  of  each  reference  lot 
and  results  from  the  two  lots  were  therefore  combined.  The  estimate 
of  the  characteristic  circular  probable  error  of  the  reference  lots, 
CPEC,  was  obtained  from  the  following  equation. 


2 

where  (CPEq) ^ was  the  square  of  the  circular  probable  error  observed 
on  the  i^  occasion. 


CPE 

In  order  to  facilitate  the  analysis,  was  defined  to  be  a. 

CPEC 

Assuming  that  CPEj.  for  the  168  reference  groups  was  equal  to  the 
characteristic  circular  probable  error  of  the  reference  lot,  then 


A., 


CPE 


0 i 


CPE, 


For  each  of  the  168  groups,  A^  was  determined  and  the  observed  cumulative 
distribution  of  the  A,, 's  was  plotted.  Figure  2 presents  the  observed 
cumulative  distribution  of  a,  and  compares  it  to  the  cumulative 
distribution  which  would  result  if  a^  were  distributed  as  a Chi-square 
with  18  degrees  of  freedom. 

From  Figure  2,  it  is  evident  that  if  2(n-l)  * ? were  distributed 

as  a Chi-square  distribution  with  18  degrees  of  freedom,  80  percent  of 
the  observations  would  be  between  0.78  and  1.20.  The  observed  cumulative 
distribution  of  the  A^'s,  however,  shows  that  80  percent  of  the 

observations  were  between  0.46  and  1.44,  a considerably  wider  spread  than 
that  predicted  by  the  Chi-square. 


The  Gamma  distribution  of  the  form  Gamma  (X)  = 
was  fitted  to  the  observed  A. 's.  With  a = 7.4558  and  $ - 


(a-ljlf?*6 
0.1261,  the 


X 

3 


Gamma  distribution  fits  the  data  very  well.  The  Chi-square,  Cramer-Von 
Mises  and  Kolmogorov-Smirnov  goodness  of  fit  tests  gave  no  reason  to 
reject  the  Gamma  distribution.  A summary  of  the  observed  \^'s  and  of 

the  fitted  Gamma  distribution  are  presented  in  Figure  3.  Each  data 
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point,  denoted  by  a triangle,  represents  the  number  of  observations 
within  an  interval  of  length  0.10.  Points  from  the  Gamma  distribution 
were  multiplied  by  16.8  so  that  the  data  and  fitted  curve  could  be  shown 
on  the  same  scale.  In  Figure  4,  the  cumulative  Gamma  distribution  is 
compared  with  the  observed  cumulative  distribution  of  the  x^'s.  The 

data  points,  denoted  by  triangles,  represent  the  observed  cumulative 
probability  that  x^  <_  x. 

4.3  Criteria  For  Acceptance  Plans 

Assuming  that  x follows  the  Gamma  distribution  with  a = 7.4558 
and  6 = 0.1261  for  random  samples  of  size  10,  acceptance  plans  can  be 
derived  with  various  levels  of  consumer's  risks  (probability  of  accepting 
a lot  with  poor  quality)  and  producer's  risks  (probability  of  rejecting 
a lot  with  good  quality).  The  limitation  of  using  this  Gamma  distribution 
is  that  It  can  only  be  used  to  calculate  consumer's  and  producer's  risks 
for  acceptance  plans  with  sample  sizes  which  are  multiples  of  ten. 
Derivations  of  distributions  applicable  to  sample  sizes  other  than  multi- 
ples of  ten  are  beyond  the  scope  of  this  report.  To  develop  an  acceptance 
plan,  it  is  necessary  to  specify  the  levels  of  characteristic  circular 
probable  errors  associated  with  both  good  and  poor  quality.  The  sampling 
procedures  and  associated  decision  criteria  must  then  be  designated. 

Once  this  is  done,  the  Gamma  distribution  can  be  used  to  derive  the 
operating  characteristics  (0C),  i.e.,  the  probability  of  accepting  a lot 
with  a specified  quality,  associated  with  the  plan.  Comparisons  of  the 
0C  of  various  plans  can  also  be  made,  and  the  best  plan  can  thereby  be 
determined. 


4.4  Development  of  Acceptance  Plans 


To  develop  the  acceptance  plans,  CPE  is  defined  as  the  level 

y 

of  circular  probable  error  which  represents  good  quality  of  a lot.  Poor 
lot  quality  can  be  characterized  by  any  multiple  of  CPEg,  as  long  as  the 

multiple  is  greater  than  one.  In  order  to  develop  examples  of  acceptance 
plans  it  is  assumed  in  this  report  that  poor  quality  is  characterized  by 
values  of  circular  probable  error  greater  than  2 CPE^.  One  possible 

acceptance  plan  Is  to  test  a ten  round  random  sample  from  a lot  and  to 
calculate  the  observed  circular  probable  error,  CPEq,  and  then,  decide 


to  accept  or  reject  the  lot.  One  set  of  decision  criteria  includes 
accepting  the  lot,  if  CPEq  < 1.2  CPEg  or  rejecting  the  lot,  if 

CPEq  > 1.2  CPEg.  This  plan  will  be  designated  as  Acceptance  Plan  A. 

Given  a circular  probable  error,  CPEL>  which  characterizes  the  lot. 


is  distributed  as  the  Gamma  distribution  discussed  in  section  4.2, 


provided  CPE^  is  not  very  different  from  the  pooled  circular  probable 
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P(Xi  <X) 


Figure  2.  Cumulative  Observed  Distribution  of  Xj 's  Compared 
With  That  Predicted  When  18  xf  is  Distributed  as 
Chi-Square  With  18  Degrees  of  Freedom. 


(XjS  X) 


error  of  the  168  reference  round 
point  is  presented  later  in  this 


is  distributed  as  the  Gamma 


groups.  Further  discussion  of  this 
section.  For  now,  it  is  assumed  that 

distribution  of  section  4.2. 


To  derive  the  consumer's  and  producer's  risks  associated  with 
this  plan,  first  assume  that  CPE.  = CPEg.  Then,  based  on  the  cumulative 
Gamma  distribution  of  Figure  4, 


P(A/CPEl  = CPEg)  = P ( CPEq  < 1.2  CPEl)  = 0.80. 

o 

Based  on  the  cumulative  distribution  of  when  is  distributed  as 

Chi-square  with  18  degrees  of  freedom  (Figure  2),  the  probability  of 
accepting  the  lot,  P(A),  is  0.90.  Assuming  that  CPE^  = 2CPEg,  then  based 

on  the  Gamma  distribution,  P(A/CPEL  = 2CPEg)  = (PCPEQ  < 0.6  CPEL)  = 0.16. 

Using  the  Chi-square  of  Figure  4,  P(A/CPEL  = 2CPEG)  = 0.00.  The  consumer's 

and  producer's  risks  for  this  plan  are  summarized  in  Table  1. 


Table  1.  Consumer's  and  Producer's  Risk  for  Acceptance  Plan  A 


Distribution  Used 

Consumer's  Risk 

Producer's  Risk 

Gamma 

0.16 

0.20 

Chi-square 

0.00 

0.10 

As  noted  in  Table  1,  the  Gamma  derived  consumer's  risk  for 
Acceptance  Plan  A is  0.16  compared  with  the  consumer's  risk  of  0.00 
predicted  by  the  Chi-square  distribution.  Thus,  use  of  the  Chi-square 
distribution  for  obtaining  the  consumer's  risk  for  this  plan  would 
mislead  one  into  thinking  that  Plan  A is  very  good  with  respect  to  the 
consumer's  risk,  while  the  Gamma  distribution  shows  that  it  is  not. 

Figure  5 presents  the  0C  curves  for  Plan  A based  on  the  Gamma 

and  Chi-square  distributions.  Note  that  the  0C  curve  derived  from  the 

Chi-square  distribution  crosses  the  Gamma  derived  0C  curve  at  the  point 

where  CPE,  = 1.12  CPE„.  When  CPE,  < 1.12  CPEn,  the  Chi-square  derived  0C 
L g L 9 

curve  overestimates  the  probability  of  acceptance  the  lot,  misleading 

the  manufacturer  into  believing  that  this  risk  is  smaller  than  it  actually 

is.  When  CPE^  > 1.12  CPEg,  the  Chi-square  derived  0C  curve  underestimates 

the  probability  of  accepting  the  lot.  Therefore,  for  lots  with  poor 
circular  probable  error  characteristics  (CPEL  > 2CPEg),  the  Chi-square 

derived  0C  curve  misleads  the  consumer  into  believing  that  his  risk  is 
smaller  than  it  actually  is. 
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In  Table  2 several  acceptance  plans  are  presented.  It  should 
be  noted  that  these  plans  represent  only  a finite  subset  of  an  infinite 
set  of  acceptance  plan  strategies. 

Table  2.  Acceptance  Plan  Alternatives  B Through  H Based  On  Multiples  Of 

Ten  Round  Samples 

Acceptance  Plan 

Designation  Description  of  Acceptance  Plan 

B Test  a single  ten  round  random  sample  from 

a lot.  Accept  the  lot  if  CPEQ  < 1.4  CPEg. 

Otherwise  reject  the  lot. 

C Test  a single  ten  round  random  sample  from 

a lot.  Accept  the  lot  if  CPE  < 1.6  CPEg. 
Otherwise  reject  the  lot. 

D Test  a single  ten  round  random  sample  from 

a lot.  Accept  the  lot  if  CPE  < 1.8  CPEg. 
Otherwise  reject  the  lot. 

E Test  two  ten  round  random  samples  from  a 

lot.  If  the  pooled  CPEq  < 1.4  CPEg,  accept 

the  lot.  Otherwise  reject  the  lot. 

F Test  a ten  round  random  sample  from  a lot. 

Accept  the  lot  if  CPEq  < 1.4  CPEg . Reject 

the  lot  if  CPE„  > 1.8  CPE  . Otherwise,  test 
o g 

a second  ten  round  random  sample.  Then, 
accept  the  lot  if  the  pooled  CPEq  < 1.4 

CPEg.  If  the  pooled  CPEq  > 1.4  CPEg,  reject 

the  lot. 

G Test  a ten  round  random  sample  from  a lot. 

Accept  the  lot  if  CPEQ  < 1.2  CPEg.  Reject 

the  lot  if  CPE„  > 1.54  CPE„.  Otherwise,  test 
o g 

a second  ten  round  random  sample.  Then,  accept 
the  lot  if  the  pooled  CPEQ  < 1.2  CPEg.  If  the 

pooled  CPEQ  > 1.2  CPEg,  reject  the  lot. 

H Test  a ten  round  random  sample  from  a lot. 

Accept  the  lot  if  CPE0  < 1.6  CPEg.  Reject 

the  lot  if  CPEq  >2.0  CPEg.  Otherwise,  test  a 

second  ten  round  random  sample.  Then,  accept 

the  lot  if  the  pooled  CPE  < 1.6  CPE  If 

o g‘ 

the  pooled  CPEQ  > 1.6  CPEg,  reject  the  lot. 


25 


Figures  6 through  12  present  the  OC  curves  for  acceptance 
plans  B through  H described  in  Table  2.  In  each  figure,  the  consumer's 

risk  is  determined  from  the  probability  of  accepting  the  lot  when 

CPE^  = 2CPEg.  When  CPE^  = CPEg,  the  producer's  risk  is  given  by  l-P(A), 

where  P ( A ) is  the  probability  of  accepting  the  lot.  The  OC  curves  for 
all  of  the  plans  show  that  the  Chi-square  derived  consumer's  and  producer's 
risks  are  lower  than  those  derived  from  the  Gamma  distribution. 

Table  3 summarizes  the  consumer's  and  producer's  risk  for 
acceptance  plans  A through  H.  The  consumer's  risks  are  presented  as 
ranges.  The  lower  bound  in  each  case  is  obtained  from  the  Chi-square 
derived  OC  curve,  while  the  upper  bound  is  obtained  from  the  Gamma 

derived  OC  curve.  The  producer's  risks  are  presented  as  point  estimates 

and  are  obtained  from  the  Gamma  derived  OC  curves. 

Table  3.  Consumer's  and  Producer's  Risks  for  Acceptance  Plans  A 

Through  H 


Acceptance  Plan 
Designation 

Consumer ' s 
Risk 

Producer 

Risk 

A 

0.00  - 0.16 

0.20 

B 

0.04  - 0.25 

0.10 

C 

0.14  - 0.40 

0.13 

D 

0.32  - 0.50 

0.07 

E 

0.00  - 0.09 

0.07 

F 

0.03  - 0.28 

0.04 

G 

0.00  - 0.16 

0.11 

H 

0.17  - 0.55 

0.02 

CPE0 

It  was  previously  assumed  that  would  be  distributed  as 

the  Gamma  distribution  with  a = 7.4558  and  B = 0.1261.  If  C°EL  equals 

the  characteristic  circular  probable  error  of  the  reference  lot  used  to 
obtain  the  fitted  Gamma  distribution,  the  assumption  is  reasonable.  The 
Gamma  distribution  was  obtained  from  the  actual  distribution  of  observed 
circular  probable  errors  over  a twelve  year  Deriod.  It  is  reasonable  to 
assume  that  this  is  representative  of  the  distribution  which  will  occur 
in  the  future.  However,  as  CPEL  deviates  from  the  characteristic  circular 

probable  error  of  the  reference  lots,  the  distribution  of  CPEq  deviates 

from  the  Gamma  distribution.  The  derived  Gamma  distribution  represents 
the  deviation  in  observed  circular  probable  errors  due  to  both  inherent 
round-to-round  differences  and  occasion-to-occasion  test  condition 
differences.  As  inherent  round-to-round  differences  increase,  which  is 
the  case  for  poor  quality  control  during  manufacturing,  they  tend  to  have 
an  Increasingly  dominating  effect  on  the  distribution  of  CPE  relative 
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to  the  effect  of  occasion-to-occasion  test  condition  variation.  As  the 
inherent  differences  increase  without  bound,  the  relative  effect  of 
occasion-to-occasion  variation  in  test  conditions  upon  CPE0  tends  towards 

CPEo 

zero,  and  the  distribution  of  *-  approaches  the  Chi-square.  On  the 

cpe£ 

other  hand,  as  inherent  round-to-round  differences  decrease,  the  scatter 
of  observed  probable  errors  is  increasingly  dominated  by  the  effect  of 

CPE 

test  condition  variation,  and  will  tend  to  have  greater  variation 

than  that  predicted  by  the  Gamma  distribution.  Consequently,  as  CPEL 

increases  towards  poor  lot  quality,  the  true  probability  of  accepting 
the  lot  lies  somewhere  between  the  probabilities  obtained  from  the 
Chi-square  and  Gamma  derived  OC  curves  as  shown  in  Figures  5 through  12. 
As  CPEL  improves  beyond  good  lot  quality,  the  probability  of  accepting 

the  lot  decreases  below  that  predicted  by  the  Gamma  derived  OC  curve. 

For  these  reasons,  the  consumer's  risks  in  Table  3 are  presented  as 
ranges,  with  the  Chi-square  and  Gamma  derived  risks  being  the  lower  and 
upper  bounds,  respectively.  The  producer's  risk,  since  it  is  based  upon 
lots  of  good  quality,  is  presented  as  a point  estimate  based  upon  the 
Gamma  derived  OC  curve.  If  CPEg  is  approximately  equal  to  the 

characteristic  circular  probable  error  of  the  reference  rounds,  the 
Gamma  derived  risk  is  a reasonably  good  estimate  of  the  producer's  risk. 
However,  if  CPEg  is  better  than  the  characteristic  circular  probable 

error  of  the  reference  rounds,  the  Gamma  derived  producer's  risk  is  a 
lower  bound.  This  could  happen  if  future  APDS  rounds  are  markedly  more 
accurate  than  the  reference  rounds. 

Reviewing  the  acceptance  plans  in  Table  3,  it  is  evident 
that  Plan  E provides  the  best  combination  of  consumer's  jnd  producer's 
risks.  However,  twenty  rounds  are  always  needed  Tor  *:,is  plan.  Plan  G 
is  the  next  best  plan  and  is  less  costly  than  Plan  E.  If  lots  are 
produced  with  CPEL  equal  to  CPE^,  the  average  sample  size  for  this  plan 

is  11.5.  This  is  due  to  the  fact  that  retests  would  occur  only  15 
percent  of  the  time. 
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Figure  6.  Operating  Characteristic  of  Acceptance 
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Figure  8.  Operating  Characteristic  of  Acceptance  Plan 
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Figure  9.  Operating  Characteristics  of  Acceptance  Plan 
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Figure  12.  Operating  Characteristics  of  Acceptance 


5.  CONCLUSIONS  AND  RECOMMENDATIONS 


In  past  acceptance  tests,  firing  procedures  have  not  been  designed 
to  minimize  the  effect  of  occasion-to-occasion  variability  in  test 
conditions  upon  target  dispersion  characteristics.  Future  tests  should 
be  designed  to  minimize  the  time  required  to  fire  a group  of  rounds  (see 
Section  2.2  for  a detailed  discussion). 

Even  when  the  time  to  fire  a group  of  rounds  is  minimized,  nonrandom 
dispersion  patterns  about  the  center  of  impact  can  occur.  In  this  case 
the  method  of  successive  differences  eliminates  the  effect  of  nonrandom 
trends  on  probable  error  estimates.  This  method  of  calculating  probable 
erro-s  should  be  employed  whenever  nonrandom  trends  in  shot  patterns 
occur  (see  Section  3 for  a detailed  discussion). 

Decision  criteria  for  acceptance  plans,  which  are  based  on  the  use 
of  circular  probable  error  estimates,  provide  the  optimum  utilization 
of  test  data.  Circular  probable  error  estimates  should  therefore  be 
used  as  the  basis  for  decision  criteria  in  future  acceptance  plans  (see 
Section  4.1  for  a detailed  discussion). 


The  distribution  of 


has  not  followed  the  Chi-square  distribution 


in  the  past.  The  ratio  of  observed  circular  probable  error  to  the 
characteristic  circular  probable  error  of  the  two  reference  lots 
followed  a Gamma  distribution  with  a = 7.4558  and  8 = 0.1261.  This 
distribution  was  used  to  obtain  the  consumer's  and  producer's  risks  for 
several  acceptance  plans.  These  risks  were  then  compared  with  the 


CPE^ 

corresponding  consumer's  and  producer's  risks  obtained  when  — ^ 

CPE^ 

follows  the  Chi-square  distribution.  It  was  shown  that  the  actual 
consumer's  risk  of  accepting  poor  lots  is  greater  than  the  Chi-square 
derived  risk  and  less  than  the  Gamma  derived  risk.  It  was  also  shown 
that  the  Gamma  derived  producer's  risk  will  provide  a lower  bound  if 
the  dispersion  characteristics  of  future  APDS  rounds  are  superior  to 
those  of  the  reference  rounds  used  in  obtaining  the  Gamma  distribution. 
From  Table  3,  it  was  evident  that  acceptance  plan  E provided  the  best 
combination  of  consumer's  and  producer’s  risks  (see  Section  4 for  a 
detailed  discussion). 
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The  acceptance  plans  presented  in  this  report  represent  only  a small 
portion  of  the  plans  which  could  be  developed  for  APDS  type  of  ammunition. 
Undoubtedly  it  will  be  necessary  to  develop  different  acceptance  plans 
for  new  types  of  APDS  rounds  undergoing  development.  These  plans  should 
be  developed  with  recognition  that  the  OC  curves  underestimate  both  the 


consumer's  and  producer's  risks,  assuming  that 


CPE^ 

0 follows  the  Chi-square 
CPE* 


distribution.  The  gamma  distribution  should  be  used  for  developing  OC 
curves  for  the  various  plans.  The  consumer's  and  producer's  risks 
associated  with  each  plan  can  be  compared  and  the  best  plan  can  then  be 
selected  (see  Section  4.3  for  a detailed  discussion). 
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APPENDIX 

Horizontal,  vertical  and  circular  probable  errors  observed  for  two 
reference  lots  of  105mm,  APDS,  M392  rounds  on  168  occasions.  A sample 
size  of  ten  was  used  on  each  occasion. 
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Probable  Error  In  Mils 


Occasion 


Horizontal 


Vertical 


Circular 


Occasion 

Probable  Error  In  Mils 

Horizontal 

Vertical 

Circular 

127 

0.22 

0.15 

0.33 

128 

0.13 

0.11 

0.21 

129 

0.34 

0.17 

0.47 

130 

0.22 

0.27 

0.43 

131 

0.29 

0.31 

0.52 

132 

0.40 

0.17 

0.53 

133 

0.50 

0.34 

0.74 

134 

0.43 

0.32 

0.66 

135 

0.54 

0.44 

0.85 

136 

0.10 

0.17 

0.24 

137 

0.33 

0.31 

0.55 

138 

0.30 

0.27 

0.49 

139 

0.27 

0.27 

0.47 

140 

0.38 

0.14 

0.50 

141 

0.43 

0.42 

0.74 

142 

0.40 

0.31 

0.62 

143 

0.17 

0.43 

0.57 

144 

0.18 

0.14 

0.28 

145 

0.33 

0.26 

0.51 

146 

0.25 

0.14 

0.35 

147 

0.20 

0.28 

0.42 

148 

0.07 

0.18 

0.24 

149 

0.18 

0.11 

0.26 

150 

0.19 

0.13 

0.28 

151 

0.16 

0.23 

0.34 

152 

0.29 

0.24 

0.46 

153 

0.19 

0.24 

0.37 

154 

0.35 

0.32 

0.58 

155 

0.18 

0.14 

0.28 

156 

0.15 

0.22 

0.33 

157 

0.24 

0.08 

0.31 

158 

0.25 

0.22 

0.41 

159 

0.25 

0.15 

0.36 

160 

0.31 

0.23 

0.47 

161 

0.21 

0.14 

0.31 

162 

0.26 

0.23 

0.42 

163 

0.23 

0.37 

0.53 

164 

0.29 

0.21 

0.44 

165 

0.16 

0.23 

0.34 

166 

0.35 

0.44 

0.69 

167 

0.28 

0.18 

0.41 

168 

0.17 

0.25 

0.37 

Average 

0.22 

0.19 

0.38 
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